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(57) Abstract: A system to provide access to information (1) related to an audio or video signal (12) being distributed to a multi- 
plicity of people at a given time includes watermarking means (9) for inserting identification codes into said audio or video signal 
before or at the time of distribution, said codes consisting of information identifying the time of distribution and the identity of the 

^ distributor, means (14) for reading the identification codes and associating a block of data stored in a data store with said identifi- 
cation codes, and communication means (6) such as a mobile phone for one or more person who has received said audio or video 

^ signal to access said block of data using either said identification codes or the identity of the distributor and the time of distribution. 
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SYSTEM TO PROVIDE ACCESS TO INFORMATION RELATED TO A 

BROADCAST SIGNAL 

This invention describes system and method to provide access to information 
5 related to a broadcast signal. 

Our co-pending patent application GB0119755.7 describes a method of 
embedding an inaudible digital watermark in audio broadcast material. The 
listener can then use a mobile wireless device, such as a WAP phone or wireless 
10 enabled portable digital assistant, to decode this watermark and direct the 
listener to an internet site that is relevant to the audio material. WO01/15357 
discloses a system having a number of similarities, but using a personal 
computer rather than a mobile wireless device. 

15 The present application describes an alternative method by which the listener 
can access further material relevant to audio/video broadcast material. It has 
the advantage that the listener does not need to have a decoder, and can access 
the further material using standard mobile phone technology. Also, the delivery 
of further material is not limited to Internet access, but can be via audio, SMS 

20 and MMS services. One aspect of this invention is that the audio/video content 
is identified by the time of its broadcast, and so is usable with live audio 
broadcast material. 

The present invention uses two pieces of information, supplied by the listener, to 
25 access further information on broadcast material: the broadcaster and the time 
of broadcast of interest to the listener. Other systems have tried similar 
approaches but have been unsuccessful. These other systems use a dedicated 
portable device to record the times of interest, and at a later delayed time, the 
portable device is connected to an internet-ready PC and the stored times are 
30 downloaded to the PC. The PC then acquires the further material via a database 
on the Internet. 
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The present invention does not require a dedicated device, but works with 
standard mobile phone technology and can be instantaneous, not delayed. 

Also, the known systems only provide half a solution. They provide a system 
5 for the listener to record times of interest and obtain further information, but 
they require the broadcaster provide and maintains accurate broadcast times. 
Known systems do not provide a mechanism to do this. Accurate time of 
broadcast information is relatively easily generated for pre-recorded 'music 
only 7 radio broadcasts. It is much more difficult to provided accurate time of 
10 broadcast information for 'live' radio broadcasts. 

Although the present invention requires time of broadcast information, it 
includes a mechanism for obtaining this information using digital watermarking 
technology. 

Music recognition services using mobile or landline phones are known based on 
passive music recognition technologies. In these systems, the listener phones a 
server and plays the music of interest down the phone line. The server analyses 
short sections of the music, typically 15 seconds, and extracts a characteristic 
fingerprint that is used as a key to locate relevant information. These systems 
work directly from the music, hence the label 'passive', and do not require 
modification to the audio signal such as the addition of a watermark. The source 
of music is not limited to broadcast material. The system is limited in that the 
characteristic fingerprint is not guaranteed to be unique to a single item of audio 
music. Also, the system cannot distinguish the context that the music was 
played in, i.e. whether the music was played by a particular radio station, was 
on recorded media, etc.. 

The present invention does provide a unique key and a context for broadcast 
30 items: the broadcaster and time of broadcast. So the listener accurately gets to 
the item of interest, and the information for a particular audio item can vary 
from broadcaster to broadcaster and even between different times of 



20 



WO 03/017540 PCT/GB02/03628 

3 

broadcasting by the same broadcaster. This is of great interest to the broadcaster 
since they are therefore included in the business model, whereas in other 
systems they are specifically bypassed. 

5 According to the present invention there is provided a system for providing 
access to information related to an audio or video signal being distributed to a 
multiplicity of people at a given time, as specified in the claims. 

Embodiments of the invention will now be described, by way of example only, 
10 with reference to the accompanying schematic drawings, in which: 

Figure 1 shows a system according to the present invention, 
Figure 2 shows the system of Figure 1 with automated insertion of broadcast 
time information, and 
15 Figure 3 shows a system in which each listener or viewer has a watermark code 
decoder. 

In a first aspect, the invention describes a method for providing relevant 
material to listeners or viewers using standard mobile phones (see Figure 1). 

20 First the broadcaster generates material that is relevant to the items that they 
will broadcast (1) and stores this material in a database (2). The database can be 
administered by the broadcaster or by a separate database service provider. 
Generic or default material may be generated that will be used for items that do 
not have any specific material associated with them. The broadcaster then 

25 broadcasts the items (3) and informs the database server of the item currently 
being broadcast (4). In this way the database server can associate every item 
with its time of broadcast. The listener hears or sees an item of interest, via the 
transmission channel (5) and immediately uses their mobile phone (6) to connect 
to the database server (2). The database server registers the time of access by the 

30 listener and correlates this with the broadcast times of the items to establish the 
item of interest to the listener. The database server then sends the material 
associated with the item to the listener via their mobile phone (6). 
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The format of the material sent by the server can be of various and multiple 
formats, compatible with the formats used by mobile phones. For example, 

a) The listener could phone the database server via a standard audio phone line. 
5 The database server would look like a call centre, providing automated 

material via interactive voice response or other material via human 
operators. 

b) providing pre-recorded and/or automated audio material and/ or material 
via a human operator. 

10 c) The listener could send an SMS or MMS message to the database server. The 
server would then send the relevant material as an SMS /MMS message back 
to the listener. 

d) The listener could access the database server via a specific WAP or HTTP 
address. The relevant material will be given via WAP or HTTP pages. 

15 

The broadcaster must supply the database server with broadcast times for all 
audio items broadcast (4). If the broadcast is pre-recorded, the audio item play 
list and associated times can be prepared in advance at the time of recording. If 
the broadcast is live, an alternative method is required. One alternative method 

20 involves the use of inaudible digital watermarks (Figure 2). The broadcaster 
embeds inaudible digital audio watermarks in selected items using an encoder 
(9). These items will be the ones for which the broadcaster has generated further 
material stored in the database. Each item can have a unique watermark. This 
may be done in advance of broadcast, for instance when the associated material 

25 is generated and stored in the database (2). These content encoded items are 
stored with other broadcastable material (10). The stored watermarked items 
are then broadcast, together with other un-watermarked items that do not have 
any specific material in the database (3). Any known watermarking technique 
may be used for encoding, however that disclosed in EP 0 245 037, EP 0 366 381 

30 or EP 0 801 855 is preferred. 
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The broadcaster also has a watermark decoding device (11) listening to the 
broadcast material in real-time. The decoding device identifies the unique 
watermark embedded in the broadcast material, or that no watermark is 
embedded. In this way, the decoding device working 'live' establishes the 
5 broadcast times of watermarked and un-watermarked items. This information is 
relayed to the database server (4). Un-watermarked items are associated with 
the generic/ default material in the database supplied by the broadcaster. 

The embedding and decoding of watermarks is the same as described in our co- 
10 pending patent application GB0119755.7. However in the present invention 
there is only one decoder operated by the broadcaster, rather than having 
decoders with all listeners/ viewers. Also, the decoder can be located at the 
front-end of the broadcast transmission chain, i.e. before the material is 
transmitted over wire and/ or radio waves and/or air etc. to the listener /viewer. 
15 Locating the decoder at the front of the transmission chain eliminates the noise 
added by the transmission chain, enabling better recovery of watermarks. 

If the database server is simultaneously managing information from multiple 
broadcasters, the listener/viewer must provide the database server with the 
20 broadcaster of interest when it accesses the server. In most situations the listener 
knows the broadcaster they are listening to. In this case the listener manually 
selects the broadcaster of interest. This could be achieved in a number of ways. 

a) The database server has a different access SMS/MMS/WAP/web address / 
phone number for each broadcaster, and the listener selects the appropriate 

25 access address. 

b) The database server has a single access SMS/MMS address, and the listener 
sends the broadcaster name in the text of the message. 

c) The database has a single access WAP/web address that accepts parameters 
to the page. The listener specifies the broadcaster as a page parameter. 

30 

These operations can be made user-friendly for the listener with a simple 
application (e.g. in Java) running on their phone, if the phone has this capability. 
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A further scheme is possible where the specification of the broadcaster is 
automated. In this scheme, the broadcaster embeds a watermark in to the 
broadcast material, and the listener has a decoder. This is the same scheme as 

5 described in GB0119755.7, except that the watermark identifies the broadcaster, 
rather than the audio content The scheme works as follows (see figure 3). Each 
broadcaster has a unique watermark. This watermark is embedded in to 
broadcast material (12). The listener activates their decoder (14) when they 
hear /see an item of interest. The viewer /listener's decoder extracts the 

10 broadcaster watermark, and automatically sends this information to the 

database server (2). The server now has broadcaster and time of broadcast and 
can retrieve the relevant material (1). A convenient place to locate the 
broadcaster encoder (12) is at the front end of the transmission chain (5). The 
viewer /listener's decoder (14) could be a separate device or could be an 

15 application running on the listener's phone. 

There are a number of advantages to this automated scheme. 

a) The automated scheme allows a simple 'one-touch' operation for the 
listener/viewer. The listener needs only to fire up the application. This can 

20 often be mapped to a single key press. 

b) The listener /viewer does not need to know the broadcaster before using the 
service. The scheme allows the listener/viewer to find out the broadcaster 
and for the broadcaster to identify themselves to potentially new customers 
(and hence revenue sources). 

25 c) By identifying the broadcaster instead of the content, the context of the audio 
material is identified. This enables the material sent to the listener /viewer to 
be more selectively targeted. For example, a song played by a radio station 
broadcaster could be associated with material about when the song or artist 
will next be on the radio station, whereas the same song played by a music 

30 retailer, broadcast inside their stores could be associated with material about 
price, where to find it etc. 
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d) By using the time of broadcast to identify the content instead from an 
embedded code, the context of the audio material is further enhanced. A 
broadcaster can associate different material for a song played at different 
times of the day. For example, each radio show may have its own web page. 
5 The information about the song could appear in the appropriate show web 
page depending on time of broadcast. 

Although in all of the above schemes the listener accesses the database server 
immediately they hear an item of interest, a scheme is possible whereby the 
10 listener's phone runs an application that simply logs the time of interest locally, 
and the database server is accessed at a later delayed time. The listener provides 
the stored time of interest to the database server upon delayed access. 

Alternatively, the listener can manually enter previous times of interest, as a 
15 method of searching the database. 

In summary, the present invention can provide the following features:- 

1) The use of conventional mobile phones to allow consumers to access context 
20 dependent information associated with broadcast material. 

2) Using the time of broadcast and broadcaster as a key to the material of 
interest. 

3) Using audio, SMS, MMS, and Internet protocols to obtain this information, 
via the listener's mobile phone. 

25 4) Using digital watermark technology to enable the broadcaster to obtain time 
of broadcast information for items. 
5) Using digital watermark technology to enable the listener to identify the 
broadcaster of material. 
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CLAIMS 

1. A system for providing access to information (1) related to an audio or 
5 video signal (12) being distributed to a multiplicity of people at a given 

time, the system including or consisting of watermarking means (9) for 
inserting identification codes into said audio or video signal before or at 
the time of distribution, said codes consisting of or including information 
identifying the time of distribution and the identity of the distributor, 

10 means (14) for reading the identification codes and associating a block of 

data stored in a data store with said identification codes, and 
communication means (6) for one or more person who has received said 
audio or video signal to access said block of data using either said 
identification codes or the identity of the distributor and the time of 

15 distribution. 

2. A system as claimed in claim 1 in which the data store is a server, and the 
communication means includes a telephone which accesses the server via 
a computer network, WWW or WAP pages, text messaging, or interactive 
voice response means. 

20 3. A system as claimed in claim 1 or claim 2 in which the data store is 

connected to means (11) for decoding said identification codes such that 
the time of broadcast of a given audio or video item is recorded in said 
data store. 

4. A system as claimed in any preceding claim in which the communication 
25 means includes means to decode and store said identification codes. 
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